A real space renormalization group approach to spin glass dynamics 
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The slow non-equilibrium dynamics ol the Edwards-Anderson spin glass model on a hierarchical 
lattice is studied by means of a coarse-grained description based on renormalization concepts. We 
evaluate the isothermal aging properties and show how the occurrence of temperature chaos is con- 
nected to a gradual loss of memory when approaching the overlap length. This leads to rejuvenation 
effects in temperature shift protocols and to rejuvenation-memory effects in temperature cycling 
procedures with a pattern of behavior parallel to experimental observations. 



Almost all glassy systems exhibit aging effects [l| which 
reflect a slowing down of the dynamics. Spin glasses ex- 
hibit the unusual feature that even small changes of tem- 
perature let them appear as if they had experienced a 
much shorter thermalization period, which is known as 
rejuvenation. Puzzlingly, they on the other hand keep 
quite accurate memories of their past thermal histories 
0, 1^ . These phenomena call for a consistent theoretical 
explanation. 

In this Letter, we construct a simple yet powerful 
coarse-grained approach for the relaxational dynamics 
of the Edwards-Anderson (EA) Ising spin glass model 
on the hierarchical lattice associated with the Migdal- 
Kadanoff (MK) approximation. This approach allows us 
to incorporate the exact real space renormalization group 
(RSRG) transformations 0, 13 into an effective non- 
equilibrium dynamics on large time and length scales, 
which remain out of reach by the conventional Monte 
Carlo technique. By employing computer simulations of 
the effective dynamics and analytical approaches com- 
bined with scaling arguments we show how temperature 
chaos 0,|EIHI3 progressively rejuvenates the system af- 
ter temperature shifts and how memory effects emerge 
after temperature cycling. 

The hierarchical lattice of the MK approximation for 
the EA model in three dimensions is constructed itera- 
tively as depicted in Fig. ^ To each bond in this lattice, 
a random exchange interaction is assigned drawn from a 




FIG. 1: Sketch of the hierarchical lattice. The iterative con- 
struction corresponds to going from the left to the right in 
the figure. Each bond in one iterative step is replaced by four 
pairs of bonds with a new Ising spin in between. 



Gaussian distribution with zero mean and variance J^. 

The hierarchical construction of the lattice implies a 
hierarchy of time scales in the system's relaxation. The 
spins {S'*-^-'} with only two neighbors introduced in the 
last iteration step belong to the lowest level of the hierar- 
chy and relax most quickly. Spins {5'"'} at increasingly 
higher levels n in the hierarchy have an exponentially in- 
creasing number 2 x 4" of nearest neighbors and relax 
with correspondingly slower rates. In the MK renormal- 
ization approach the spins {iS'*^"-'} are associated with an 
exponentially increasing length scale L„ = 2"Lo where 
Lo is the lattice constant. For temperatures T below 
the spin glass transition temperature Tc ~ 0.88 J 0, the 
effective energy barrier En, for excitations ( "flips" of do- 
mains or droplets 0, see below) of length scale L„ will 
scale as En ^ J{Ln/ Lq)"^ with some exponent i/;. Hence 
we define the relaxation time t„ for spins at level n as 

i„/To = exp[(J/T)(L„/Lo)'1 - exp[2"'^(J/r)] , (1) 

where tq is a microscopic time unit. The time period i„ 
is denoted as the nth epoch following 0. 

Our effective dynamics proceeds by successive epochs. 
Since these grow with level n exponentially even on a 
logarithmic time axis, we consider, in the nth epoch, 
the spins {5("+i'"+2, - )| be frozen in and the spins 
|5(n,n-i,...,o)| fluctuate with strongly decreasing re- 
laxation times tn 3> t(n-i) S> . . . 3> io- In the nth epoch, 
we then first thermalize (align with Boltzmann weights) 

the spins 5^^"' in their effective (time-averaged) local 

fields h'f^^Y.. jjg^g j(n) ^j^g 

fective couplings given by the RSRG transformation [J, 13 

= rELitanh-i[tanh(ji"-^VT)tanh(j]r'VT)] , 
which take into account the thermalization of the faster 

spins at lower levels n' < n. In the second step, 
the spins 5^^" are thermalized in their effective lo- 
cal fields h["~^\ which depend on the spins S"}"^ up- 
dated in the first step (and the effective couplings 
|j(n-i)|-j gy repeating this procedure, the spins 
{5(")},{S'("-i)},...,{S'(°)} are updated one after the 
other in the nth epoch. 



To characterize the non-equiHbrium properties of the 
system we consider a quench from T = oo to T < Tc at 
time zero and study the spin autocorrelation function 

where (. . .) denotes a thermal average and an average 
over random initial spin orientations for a fixed realiza- 
tion of the disorder, while the bar denotes the disorder av- 
erage over the random bonds. The Wa > Oi X]q = 1, 
are weighting factors, which allow one to take into ac- 
count that spins at different levels are not equivalent. A 
natural choice is to take Wa proportional to the connec- 
tivity oc 4" of spins {S'*-"-'} and we present our results 
for this case. We have checked, however, that the choice 
Wa = const. yields analogous results. Recently, direct 
experimental measurements of the correlation function 
have been conducted in a spin glass 10]. 

The time evolution of the system is best analyzed in 
terms of clusters, which are realizations of domains or 
droplets postulated in scahng arguments 0- A cluster 
is defined for each effective coupling and consists 
of all faster spins at levels below a, which are traced 
out in the RSRG to give J^°'\ Each cluster has two 
boundary spins which are the spins connected by J*-"-* 
after renormalization. One is a spin S^"^ at level a, which 
we call the "master spin" of the cluster. The other is a 
still slower spin of level 7 > a. An important remark is 
that 2 J*^") is the difference of the cluster's free energies of 
the cases that the boundary spins are parallel and anti- 
parallel. If the master spin flips but the slower boundary 
spin keeps unchanged, the spins in the interior of the 
cluster are exposed to a "twisted-boundary condition", 
which triggers flips of a 0(1) fraction of these spins. It 
is by this mechanism that fluctuations occurring at high 
levels propagate down and erase correlations of the low- 
level spins. 

In fact, these de-correlations caused by twisted bound- 
aries can be quantified in a precise manner. Let us con- 
sider a certain spin 5*^"' at level a. Since the clusters are 
hierarchically nested, this spin S'^"^ is part of unique clus- 
ters with master spins S^'<\ 7 > a. By using symmetry 
considerations we can write for the correlator appearing 
in Eq. © 

(5(")(t„+t„0^(")(<„)) = (3) 

in 

[l-2r„(t„,,t„)] Jl [l-r^(tm,t„)], 

where r^{tm^tn) is the probabihty that the spin 
flips between tn and i„ -I- t„i under the condition that 
the master spins S'^'''-* remained unchanged (for a given 
realization of the disorder). The product over 7 in 
Eq. (j3Jl is the consequence of the twisted boundary ef- 
fect: None of the boundary spins of the "super" -clusters 
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FIG. 2: Spin autocorrelation function C{tm,t„) as a function 
of L(tm) at T/Tc = 0.3 (open symbols) and Tc = 0.7 (filled 
symbols) for L(t„)/Lo = 2^2^...,2" (from left to right). 
Here and in the following, the system size was 2^^ Lq. 

containing the spin S*'"-* is allowed to flip between t„ and 
in + trm if S^"^ {tn + tm) should givc a non-zero over- 
lap with S''"^{tn). For small flip probabilities ^ 1, 
the right hand side of Eq. (jJJ can be linearized, yielding 

1 — 2fa — J2j=a+1 ^7- 

Isothermal aging - Let us first discuss the isothermal 
aging properties. Fig. [3 shows the simulated C{tm,tn) 
as a function of L(i„)/Lo = [(T/ J) log(t™/ro)]^/^ [cf. 
Eq. J^l] • Clearly, there are two different regimes, a quasi- 
equilibrium regime with a slow decay for L(im) < L[tn) 
and the aging regime with a fast decay for L{tm) > L{tn)- 

Relaxation in the quasi-equilibrium regime Lit^) < 
L[tn) is close to that of the equilibrium limit Ccq(t„j) = 
lim„^oo C(tm, in)- In the low-T limit the behavior of 
C'oq(im) can be derived by considering thermal fluctua- 
tions from the ground states. At T = a spin s\"''^ points 
in the direction of the effective local field h!f\ Accord- 
ingly, for T f^Q spin flips become likely if the energy gap 

Aq = 2|/i|"''| is smaller than the thermal energy T. We 
have investigated numerically the distribution p(Ac) of 
the energy gaps and found that it follows an analogous 
scaling form as the distribution of renormalized bonds 

where p(0) > and ~ 0.26 |i| is the stiffness expo- 
nent. As a consequence, we obtain up to terms of order 
0{T^, L~^~^) for the disorder averaged flip probabilities 
~ c{T / J){L^ / Lq)-^ < 1 with c = p(0)/2. Using the 
linearized form of Eq. this yields 

C.^{tm)-q^A + c'^{^^^ \ (5) 

where c' = c/(2^ — 1) and the Edwards-Anderson or- 
der parameter gEA decreases linearly with T, q-^A ~ 
1 — const. T. Indeed, we could well flt the data in Fig. [21 
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to Eq. (O and thereby extract gEA, which we found to 
decrease hnearly with T except possibly close to Tc- 

In the aging regime L{tm) > Litn), the master spins 
at levels n < j < m are newly thermalized and flip with 
probability — 1/2. Taking this into account in Eq. Q 
we find the exact relation 



-A 



(6) 



with A = 1. Equations H5I6|I agree with the scaling forms 
suggested by the droplet scaling theory . 

Temperature/bond shift protocols - Next we proceed 
to our central issue and investigate the implication of 
temperature chaos on aging and rejuvenation effects in 
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FIG. 3: (a) Spin autocorrelation function C{tm,tn) as 
a function of L{tm) in twin temperature shift protocols 
{0.3Tc,0.7Tc) (open symbols) and (0.7Te, O.STc) (filled sym- 
bols) for L(tn)/Lo = 2°, 2^ . . . , 2" (from left to right). Ac- 
cording to |5|, the overlap length between the two temper- 
atures is L*/Lo — 2^ — 2^. (b) Scaling plot of the nor- 
malized autocorrelation function Cao{tm;5) as a function of 
[L{tm)/L*{5)]'^ with C = 0.74 P. The open/filled symbols are 
for temperature/bond shifts with 5 = 0.1 (square), 0.2 (cir- 
cle) and 0.5 (triangle). The T-shifts started from Ti = 0.3Tc, 
while the bond shifts were in the T = 0-limit of the dynam- 
ics. The prefactor of L* (5) is chosen such that the two master 
curves for temperature and bond shifts merge with each other. 
The inset shows the initial decay of C'oo(im;<5) in agreement 
with Eq. Q. 



temperature shift protocols (Ti,T2). The system evolves 
first at temperature T\ for time i„ and then the temper- 
ature is switched to = T\ ^ AT, corresponding to a 
perturbation of strength (5 = |AT|/Tc. 

Figure 13^ shows the correlation function C(tm,tn) as 
a function of L{tm) obtained from our computer simu- 
lations. As in Fig. 13 we can identify an aging regime 
for L{tm) > L(tn)- Indeed the scaling from Eq. © 
holds exactly with the same underlying mechanism as 
in the isothermal case. In this respect the aging effect 
does not stop. However, the limiting curve Coo (^m ) — 
lim„^oo C{tm,tn) decays to zero for <,„ — > oo while that 
of isothermal aging converges to the plateau ^ea [see 
Eq. lO]. Hence the aging effect becomes progressively 
irrelevant and the system rejuvenates, suggesting that 
temperature chaos effect is coming into play. 

Another remarkable observation from Fig. is that 
C{tm,tn) remains unchanged when Ti and T2 are in- 
terchanged. Due to symmetry this must hold true for 
tm = tn, and, because of ©, it is exactly valid for 
tm, > tn also. For tm < tn, it cau be shown based 
on Eq. (O that deviations, if occurring at all, must be 
very small. The symmetry supports the results of recent 
"twin-experiments" performed on a spin glass . 

To understand the behavior of Coo{tm) it is impor- 
tant to note that a temperature shift affects the spin 
flip probabilities in two ways: (i) it changes the effec- 
tive couplings due to the T-dependence of the RSRG 
transformations and hence the effective fields, and (ii) it 
changes the weighting of these fields in the Boltzmann 
probabilities. In order to isolate the subtle effect (i) 
from the obvious effect (ii) we introduce a correlation 
function that is normalized by the isothermal correla- 
tion functions at temperatures Ti and T2, Coo{tm) = 
Coo{tm) / \/Ccq{tm)TiCcqitm)T2- K cau be showu that 
Coo — I + 0{d^) if effect (i) is absent. 

Now we can focus on effect (i) and estimate the in- 
duced flip probability faiS) of a master spin 5*^"^. A 
flip of such a spin becomes likely if the typical change 
of effective couplings A J^"^ induced by the temperature 
shift exceeds the original energy gap Aq, before the shift, 

,(6) ~ /o'^'^*"' dA„p(A„). As noted above, 2J(") is 



I.e. To 

the difference of the free energies of the associated clus- 
ter between the two states with parallel and anti-parallel 
boundary spins, which below Tc have a "relative domain 
wall" that passes through L^^^ links. Accordingly, one 
can write for the free energy change 2AJ*^") ~ A[TSa], 
where Sa is the difference of the entropies associated 
with the two states. As shown in 0, 0j 'Sa is the 
sum of random local entropy fluctuations associated with 
the L^^^ links along the relative domain wall, yielding 
Sa ii'*"^^^^ It follows that AJ(°) - 5L^a^^'>^^ and 
hence f^(<5) - Jo^"'^^'^^^^' dyp{y), where L*{S)/Lo - 
(5^^/'' is the so-called overlap length. The exponent 
C = (d — I)/2 — ~ 0.74 is called the chaos exponent 
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FIG. 4: Rejuvenation and memory: relaxation of the auto- 
correlation function after one-step temperature cycling Ti —* 
T2 Ti with Ti = O.STc and T2 = 0.7Tc. The duration of 
the first stage is varied as L(tn)/Lo = 2°, 2^, . . . , 2^* from left 
to right. The duration of the second stage is L{t„i)/Lo — 2"^ 
(open symbols) and 2® (filled symbols). 

m 

In the weakly perturbed regime L{t„i) ^ L*(6) the flip 
rates are small, r^{5) ~ p{Q)[L^ / L* {5)]'^ , and using the 
linearized Eq. ||2J) we obtain 

C„o(i™;<5) = l-cp(0)(^|^y (7) 

where c is a constant. Quite importantly this means that 
the rejuvenation effect does not appear suddenly at the 
overlap length L*{5) but rather gradually emerges. Very 
similar scaling for the emergence of the rejuvenation ef- 
fect is found in the "twin-experiment" mentioned above 

i 

In the late stage L{tm) ^ L*{5), which we call strongly 
perturbed regime, the flip rates become 1/2. Then simi- 
larly to Eq. © we expect, 

(?oo(i™;^)^(|^)'' (8) 

with A = 1. 

Equivalent effects are expected for bond shifts ■ 
In a bond shift, the bare couplings Jij are replaced by 
{J,j + 54)/VT+72, where 4 are Gaussian random 
numbers obeying the same statistics as the Jy , and 5 
is the perturbation strength. 

We tested the above scaling ansatz numerically. As 
demonstrated in Fig. they work very well. Quite re- 
markably the form of the master curve is apparently uni- 
versal for both temperature and bond shifts. 

Temperature cycling- Finally, we study rejuvenation 
and memory effects after one step temperature cycling. 
Therein, the system evolves at a temperature Ti for a 
time tn and subsequently at another temperature T2 for 
a time tn' ■ Then the temperature is put back to Ti and 
we measure the autocorrelation function C(im, t„). 



which is the overlap between the spin configuration at 
time tn + tn' and that after some additional time tm- 

Figure 01 shows the simulated data. The initial decay 
shows rejuvenation: There is no trace of aging during the 
first stage and C{tm,tn' jin) follows the autocorrelation 
function C{tni,tn']5 = \Ti — Ti\lT^ as after a simple 
T-shift (T2,Ti). If Lxiitn) > LT^itn')^ this rejuvenated, 
new aging is however terminated after the recovery time 
tm* determined by LT-i{tm*) — LT2{tn') H]- There, 
a plateau region shows up indicating that the system's 
evolution recovers length scales already thermalized at 
temperature Ti during the first stage. Eventually, for 
tm > tn, the system also memorizes the limits of this 
first thermalization and C{tm,tn' ,tn) enters a steep de- 
cay analogous to Eq. 10 in the isothermal case. We con- 
firmed that bond cycling yields analogous results. 

The two stage relaxation is reminiscent of the exper- 
imentally observed rejuvenation-memory effects 0, 0]. 
Here slow spins play the role of ghost domains proposed 
in [ll| . After strong perturbations, configurations of 
faster spins which occupy a dominant portion of the vol- 
ume of a cluster are changed but slower spins in the same 
volume retain their original configuration. The slower 
spins act as remanent symmetry breaking fields by which 
both the original amplitude and sign of the overlap with 
respect to the equilibrium state can be restored. 
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